Papers with decision-making process
Copied to clipboard
| Challenge: | ACL 2025 received more than 8300 submissions and accepted 1700 at the main conference and 1392 as findings. |
| Approach: | ACL 2025 received 8300 submissions and accepted 1700 at the main conference and 1392 as findings. |
| Outcome: | ACL 2025 received 8300 submissions and accepted 1700 at the main conference and 1392 as findings. |
Copied to clipboard
| Challenge: | ACL 2025 received more than 8300 submissions and accepted 1700 at the main conference and 1392 as findings. |
| Approach: | ACL 2025 received 8300 submissions and accepted 1700 at the main conference and 1392 as findings. |
| Outcome: | ACL 2025 received 8300 submissions and accepted 1700 at the main conference and 1392 as findings. |
Copied to clipboard
| Challenge: | ACL 2025 received more than 8300 submissions and accepted 1700 at the main conference and 1392 as findings. |
| Approach: | ACL 2025 received 8300 submissions and accepted 1700 at the main conference and 1392 as findings. |
| Outcome: | ACL 2025 received 8300 submissions and accepted 1700 at the main conference and 1392 as findings. |
Copied to clipboard
| Challenge: | Attention mechanisms play a central role in NLP systems, especially within recurrent neural network (RNN) models. |
| Approach: | They propose to use a simple uniform-weights baseline, a variance calibration and a diagnostic framework to determine when/whether attention can be used as explanation in RNN models. |
| Outcome: | The proposed tests show that even reliable adversarial distributions don't perform well on the simple diagnostic, indicating that prior work does not disprove the usefulness of attention mechanisms for explainability. |
Copied to clipboard
| Challenge: | Graph representation learning has garnered significant attention due to its broad applications in various domains, such as recommendation systems and social network analysis. |
| Approach: | They propose to use a generative language model to map input-output pairs to explanations reflecting the model’s decision-making process to generate a model that generates pseudo-labels that capture the model's decisions from saliency-based explanations. |
| Outcome: | Extensive experiments show that GraphNarrator produces human-preferred explanations that are faithful, concise, and human-like. |
Copied to clipboard
| Challenge: | This tutorial will provide a background on interpretation techniques for neural NLP models. |
| Approach: | This tutorial will provide a background on interpretation techniques for NLP models . it will examine saliency maps, input perturbations, adversarial attacks and influence functions . |
| Outcome: | This tutorial will provide a background on interpretation techniques . examples-specific interpretations include saliency maps, input perturbations, adversarial attacks, influence functions . |
Copied to clipboard
| Challenge: | Existing tools focus on isolated parts of the decision-making process, but LM-TT makes the entire prediction process transparent. |
| Approach: | They present an open-source toolkit for analyzing the internal workings of Transformer-based language models. |
| Outcome: | The LM Transparency Tool makes the entire prediction process transparent . it shows the importance of specific component at each step . |
Copied to clipboard
| Challenge: | Existing LLM-based agents struggle with low diversity and suboptimal code generation. |
| Approach: | They propose an approach that iteratively expands tree nodes through an introspective process that meticulously analyzes solutions and results from parent and sibling nodes. |
| Outcome: | The proposed approach shows a 4% improvement in performance compared to the strong open-source AutoML agents. |
Copied to clipboard
| Challenge: | Existing approaches to generating reviews struggle to generate justifications that are relevant to users’ decision-making process. |
| Approach: | They propose an ‘extractive’ approach to identify review segments which justify users’ intentions and use it to distantly label massive review corpora and construct large-scale personalized recommendation justification datasets. |
| Outcome: | The proposed model can generate convincing and diverse justifications from massive review corpora and distantly label massive review data. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have created a number of use cases in the medical field . omissions in summaries can jeopardize the decision-making process . |
| Approach: | They propose a dataset to evaluate omissions in large-scale medical summaries . they propose 'embedKDECheck' method that uses embeddings generated by a third-party NLP model . |
| Outcome: | The proposed method is well-suited for resource-constrained environments. |
Copied to clipboard
| Challenge: | Existing methods for explaining neural models are misleading as they often present reasons that are unfaithful to the model’s inner workings. |
| Approach: | They propose a counterfactual input editor for inserting reasons that lead to counterfacts but are not reflected by the NLEs. |
| Outcome: | The proposed model can evaluate emerging NLE models, proving a fundamental tool in the development of faithful explanations. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been exhibiting outstanding abilities to reason around cognitive states, intentions, and reactions of all people involved, letting humans guide and comprehend day-to-day social interactions effectively. |
| Approach: | They propose to use multiple-choice questions (MCQ) benchmarks to assess LLMs' ability to reason around cognitive states, intentions, and reactions of all people involved to investigate their resilience abilities. |
| Outcome: | The proposed models exhibit exceptional abilities to reason around cognitive states, intentions, and reactions of all people involved, letting humans guide and comprehend day-to-day social interactions effectively. |
Copied to clipboard
| Challenge: | Transformer model has been a de-facto standard in natural language processing, but it is limited to images, text, and/or sequence data. |
| Approach: | They propose to use a multimodal large language model architecture to handle biomedical graphs such as protein structure and chemical molecules to improve its performance. |
| Outcome: | The proposed architecture can handle multiple data types for biomedical graphs such as protein structure and chemical molecules. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are becoming more autonomous and capable of handling real-world tasks through their access to tools, various planning strategies, and memory, referred to as LLM agents. |
| Approach: | They introduce a personalized version of TravelPlanner and establish baselines for personal LLM agents by comparing generic and personal plans. |
| Outcome: | The proposed model encapsulates user-related information, preferences, and personal concepts and provides baselines for personal LLM agents. |
Copied to clipboard
| Challenge: | Existing state-of-the-art event coreference resolution systems rely on spurious and spurious associations in the input mention pair text. |
| Approach: | They propose a rationale-centric counterfactual data augmentation method that leverages the debiasing capability of counterfact data haussed by LLM-in-the-loop to mitigate spurious association while emphasizing causation. |
| Outcome: | The proposed method achieves state-of-the-art on three popular cross-document benchmarks and demonstrates robustness in out-of domain scenarios. |
Copied to clipboard
| Challenge: | Existing LLMs operate as an opaque process without explicit separation between knowledge retrieval and reasoning steps, making the decision-making process unclear and disorganized. |
| Approach: | They propose a language model inference paradigm that decomposes the complex inference process into two distinct and clear actions: (1) memory recall: which retrieves relevant knowledge, and (2) reasoning: which performs reasoning steps based on the recalled knowledge. |
| Outcome: | The proposed paradigm decomposes the inference process into two distinct and clear actions, memory and reason, guiding the model to distinguish between steps that require knowledge retrieval and those that involve reasoning. |
Copied to clipboard
| Challenge: | Neural metrics for machine translation evaluation are considered "black boxes" lexical overlap-based metrics are popular for evaluation of translation systems and algorithms . |
| Approach: | They develop and compare several neural explainability methods to understand translation errors . they aim to better understand the correspondence between token-level explanations and human annotated error spans . |
| Outcome: | The proposed methods leverage token-level information that can be directly attributed to translation errors. |
Copied to clipboard
| Challenge: | Existing approaches to define action spaces for conversational agents have limitations . end-to-end dialog systems can handle complex domains with limited action space . |
| Approach: | They propose a latent action framework that treats the action spaces of an end-to-end dialog agent as latent variables and develops unsupervised methods to induce its own action space from the data. |
| Outcome: | The proposed framework achieves better performance than word-level policy gradient methods on DealOrNoDeal and MultiWoz dialogs. |
Copied to clipboard
| Challenge: | Several proposals have been put forward for improving out-of-distribution performance by mitigating dataset biases. |
| Approach: | They propose a fine-tuning strategy that incorporates the similarity between the main and biased model attribution scores in a Product of Experts (PoE) loss function to further improve OOD performance. |
| Outcome: | The proposed method improves OOD performance while maintaining in-distribution performance. |
Copied to clipboard
| Challenge: | Prior research on meta-reviewing has treated this as a summarization problem over review reports . prior research demonstrated that decision-makers can be effectively assisted in such scenarios via dialogue agents. |
| Approach: | They propose to use large-scale large-language models to generate synthetic data for meta-reviewing . they then use these data to train dialogue agents tailored for meta review . |
| Outcome: | The proposed method outperforms *off-the-shelf* dialogue agents in meta-reviewing scenarios. |
Copied to clipboard
| Challenge: | Absence of equitable and inclusive principles can hinder the formation of common ground, which in turn negatively impacts the overall performance of the system. |
| Approach: | They propose to use theories of computational learning to study equitable text generation in dialogues using augmented data to prove formal definitions of equity in text generation and formal connections between human-likeness and learning equity. |
| Outcome: | The proposed model predicts relative-performance of multiple algorithms in generating equitable text as measured by human and automated evaluation. |
Copied to clipboard
| Challenge: | Modern and post-modern free verse poems feature a large and complex variety in their prosodies that falls along a continuum from a more fluent to a disfluent and choppy style. |
| Approach: | They propose a method for automatic prosodic classification of spoken free verse poetry that integrates source text and audio and predicts the assigned class. |
| Outcome: | The proposed method can be validated on a large corpus of German author-read post-modern poetry and achieves a weighted f-measure of 0.73 when combining textual and phonetic evidence. |
Copied to clipboard
| Challenge: | Existing deep learning models have the attention mechanism to improve performance, but the inherent characteristics of deep learning model complexity and the flexibility of the attention structure make them difficult to explain. |
| Approach: | They propose a two-tier attention architecture to decouple the complexity of explanation and the decision-making process by using large-scale news corpora. |
| Outcome: | The proposed model can achieve competitive performance with state-of-the-art models and illustrates its appropriateness from an explainability perspective. |
Copied to clipboard
| Challenge: | Existing models for explainable recommendation have neglected faithfulness of KG reasoning . |
| Approach: | They propose to draw on interpretable logical rules to guide path-reasoning process for explanation generation. |
| Outcome: | The proposed method delivers high-quality recommendations and ascertains the faithfulness of the derived explanation. |
Copied to clipboard
| Challenge: | In many settings, it is important to understand a model’s decision-making process. |
| Approach: | They propose a method for introducing human interpretability in deep language representations by encoding a passage of text as a layer of interpretable categories. |
| Outcome: | The proposed method outperforms existing interpretable language representations on downstream tasks and on agreement with human characterizations of the text. |
Copied to clipboard
| Challenge: | Proper moral beliefs are fundamental for language models, yet assessing these beliefs poses a significant challenge. |
| Approach: | They propose a framework to evaluate the moral beliefs of four large language models . they use a dataset containing 472 moral choice scenarios in Chinese . |
| Outcome: | The proposed framework evaluates the moral beliefs of four large language models. |
Copied to clipboard
| Challenge: | Existing methods for creating a vision question-answering with natural language explanations rely on human annotations that are time-consuming and costly. |
| Approach: | They propose a method that generates high-quality natural language explanations using LVLMs by using visual prompts. |
| Outcome: | The proposed method generates high-quality synthetic VQA-NLE datasets 20x faster than human annotations with minimal decrease in qualitative metrics. |
Copied to clipboard
| Challenge: | Existing methods for user profile modeling extract only partial segments from full historical behavior sequence, resulting in incomplete modeling and suboptimal profiling. |
| Approach: | They propose an agent-agnostic LLM-UM framework to augment downstream recommendation agents . it segments complete historical behaviors into clustered groups and performs offline multi-persona profiling . |
| Outcome: | The proposed framework improves agent performance and inference efficiency by 31% and 10% using 30–50% of behavioral data. |
Copied to clipboard
| Challenge: | Large scale language models (LLMs) have demonstrated impressive performance in various tasks and are increasingly integrated into the decision-making process. |
| Approach: | They propose a framework for INvestigating Value Priorities through decision-making in social scenarios and evaluate seven popular LLMs. |
| Outcome: | The proposed framework covers 1613 scenarios and 3226 decisions across 283 topics and focuses on Universalism and Benevolence, while Power and Hedonism are given lower priority. |
Copied to clipboard
| Challenge: | Empathetic dialogue requires not only recognizing a user’s emotional state but also making strategy-aware, context-sensitive decisions throughout response generation. |
| Approach: | They propose a STRategy-grounded, interpretable, and DEep reasoning framework that models Empathetic Dialogue through structured, strategy-conditioned reasoning. |
| Outcome: | The proposed framework outperforms existing methods on automatic metrics and human evaluations. |
Copied to clipboard
| Challenge: | escalation in emergency department patient visits poses challenges to efficient clinical management . Currently, hospitals rely on human experts to review clinical notes and determine case urgency . |
| Approach: | a team of researchers develop a multi-agent framework to enhance collaborative decision-making in clinical triage. |
| Outcome: | The proposed framework outperforms state-of-the-art LLM-based methods on three clinical triage test sets. |
Copied to clipboard
| Challenge: | Currently, only 20% of the English comments explicitly mention content moderation policies, but as few as 2% of the German and Turkish comments. |
| Approach: | They propose to use a multilingual dataset to predict stances with existing content moderation policies and to use them to explain moderation decisions. |
| Outcome: | The proposed model predicts stances and corresponding reasons with high accuracy, adding transparency to the decision-making process. |
Copied to clipboard
| Challenge: | a promising research direction consists of designing neural models capable of generating natural language explanations for their predictions. |
| Approach: | They propose a framework for sanity checking models against inconsistent explanations . they apply the framework to a state-of-the-art neural natural language inference model . |
| Outcome: | The proposed framework can generate inconsistent explanations on a state-of-the-art model . it also addresses the problem of adversarial attacks with full target sequences . |
Copied to clipboard
| Challenge: | Pretrained language models (LMs) are the main interface for applying them to new tasks, but their large size makes them difficult to fine-tune with gradients for specific downstream tasks. |
| Approach: | They propose to use training data to form a decision tree based on prompt-LM calls, with each prompt determined by the outcomes of previous calls. |
| Outcome: | The proposed method improves accuracy over competing methods and is competitive with fine-tuning. |
Copied to clipboard
| Challenge: | Existing claims verification models rely on annotated data, which is expensive to create at a large scale. |
| Approach: | They propose a model that can verify complex claims without annotated data . they leverage the in-context learning ability of Large Language Models to translate a claim into a First-Order-Logic clause . |
| Outcome: | The proposed model outperforms baseline models on three datasets . it performs well on the datasets, and the results are published online. |
Copied to clipboard
| Challenge: | Simultaneous Speech Translation (SimulST) is a task focused on ensuring high-quality translation of speech in low-latency situations. |
| Approach: | They propose a token-level cross-modal alignment method to improve the translation of text to audio . they use audio transcription pairs to pre-train the encoder and a random wait-k-tokens strategy to optimize the task. |
| Outcome: | The proposed method achieves better trade-off between translation quality and latency. |
Copied to clipboard
| Challenge: | Existing approaches to combining knowledge graphs with large language models face limitations in path exploration strategies or excessive computational overhead. |
| Approach: | They propose a training-free framework that synergizes Monte Carlo Tree Search with LLM capabilities to enable dynamic reasoning over KGs. |
| Outcome: | The proposed framework outperforms existing training-free methods and achieves competitive performance compared to fine-tuned baselines. |
Copied to clipboard
| Challenge: | Existing CRSs assume that users like all attributes of the target item and dislike those unrelated to it, which can introduce bias in attribute-level feedback and impede the system’s ability to accurately identify the target items. |
| Approach: | They propose a framework that allows users to explicitly acquire user preferences through natural language conversations by providing explicit answers (yes/no) for each attribute they require. |
| Outcome: | The proposed framework portrays the conversation as a hierarchical interest tree that consists of two stages. |
Copied to clipboard
| Challenge: | Graphical User Interface (GUI) agents aim to automate a wide spectrum of human tasks by emulating user interaction. |
| Approach: | They propose a deliberative framework that leverages a fine-grained tip retrieval mechanism to inform its decision-making process. |
| Outcome: | The proposed framework achieves SOTA among open-source general models on AndroidWorld and ScreenSpot-V2 . it leverages a fine-grained, app-specific tip retrieval mechanism to inform its decision-making process . |
Copied to clipboard
| Challenge: | Existing work focuses on capturing user implicit preferences from historical interactions and matching them with the next behavior, instead of predicting user explicit intentions. |
| Approach: | They propose an adversarial user intention learning approach for sequential recommendaiton . the approach explicitly predicts user current intentions by taking historical reviews as inputs . |
| Outcome: | The proposed approach explicitly predicts user intentions by inferring their decision-making process as explained in target reviews. |
Copied to clipboard
| Challenge: | Large language models face significant challenges in interpretability of dialogue flow and reproducibility of expert knowledge. |
| Approach: | They propose a method that extracts flowcharts from dialogue data and incorporates them into large language models to improve interpretability and reproducibility. |
| Outcome: | The proposed method reconstructs expert decision-making paths with high precision and recall scores on dialogue datasets. |
Copied to clipboard
| Challenge: | Experimental results demonstrate that our method effectively enhances safety in code execution and mobile device control tasks. |
| Approach: | They propose a technique that leverages causal influence diagrams to identify and mitigate risks arising from agent decision-making. |
| Outcome: | The proposed method enhances safety in code execution and mobile device control tasks. |
Copied to clipboard
| Challenge: | Existing methods to detect rumors from the perspective of modality tampering are labor-intensive and time-consuming. |
| Approach: | They propose a short video rumor detection framework that integrates modality tampering detection and inter-modal matching into a model to detect modality-tampers and interpretability mechanisms to make the results more reasonable. |
| Outcome: | The proposed model improves on the short video rumor dataset by 4.6%-12% compared with other models and can explain whether the short clip is a rumour or not through the perspective of modality tampering. |
Copied to clipboard
| Challenge: | Existing models for extractive rationales do not work as well on reasoning tasks requiring free-text rationale. |
| Approach: | They propose to use pipelines to extract rationales from input words and to use them to explain reasoning tasks. |
| Outcome: | The proposed models exhibit desirable properties for explaining commonsense question-answering and natural language inference, indicating their potential for producing faithful free-text rationales. |
Copied to clipboard
| Challenge: | Recent work focused on training largescale and complex neural network models, but they are opaque in terms of their decision-making process. |
| Approach: | They propose a multi-task teacher-student framework for self-training pre-trained language models with limited task-specific labels and annotated rationales. |
| Outcome: | The proposed model improves performance in low-resource settings by making it aware of its rationalized predictions. |
Copied to clipboard
| Challenge: | Existing methods for mitigating toxic content are black-box approaches, which results in limitations in modifying toxic tokens. |
| Approach: | They propose a method that integrates token-level toxicity explanations with the masking and infilling detoxification processes. |
| Outcome: | The proposed method outperforms baseline methods in fluency and toxicity reduction. |
Copied to clipboard
| Challenge: | Recent advances in tool learning have enabled large language models to integrate external tools, enhancing their task performance by expanding their knowledge boundaries. |
| Approach: | They propose a framework that combines probabilistic knowledge boundary estimation with dynamic decision-making to allow LLMs to better assess when to invoke tools based on their confidence. |
| Outcome: | The proposed framework shows significant improvements in tool efficiency by reducing unnecessary tool usage. |
Copied to clipboard
| Challenge: | Existing methods for detecting fake news are limited due to non-transparent reasoning processes and inherent risks of integration with large language models. |
| Approach: | They propose a framework for trustworthy fake news detection that prioritizes explainability, generalizability and controllability of models. |
| Outcome: | The proposed framework prioritizes explainability, generalizability and controllability of models. |
Copied to clipboard
| Challenge: | Despite its significance, a systematic exploration of commonsense causality is lacking. |
| Approach: | They focus on taxonomies, benchmarks, acquisition methods, qualitative reasoning, and quantitative measurements in commonsense causality. |
| Outcome: | The proposed method synthesizes insights from over 200 representative articles and provides a practical guide for beginners. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have led to an explosion of interest in their deployment as agents. |
| Approach: | They propose a method that enhances agents’ focus on task-relevant contexts by constructing a belief state via question answering. |
| Outcome: | The proposed method outperforms established baselines and achieves marked improvements on the BeIR zero-shot retrieval benchmark. |
Copied to clipboard
| Challenge: | Deep learning models lacking interpretability and interactivity, authors say . lack of interactive mechanisms prevents clinicians from incorporating their own knowledge into decision-making process. |
| Approach: | a new deep learning model is proposed to improve interpretability and interactivity . authors propose a knowledge-enhanced agent-driven causal discovery framework . |
| Outcome: | a new model improves interpretability and interactivity on EHR data . the proposed model improve interpretability through explicit reasoning and causal analysis . |
Copied to clipboard
| Challenge: | Existing methods for web agents struggle with efficient navigation and action execution due to limited visibility and understanding of web structures. |
| Approach: | They propose a framework that integrates memory-enhanced navigation and reflective learning to improve web agents' performance. |
| Outcome: | The proposed framework shows significant improvements over existing methods, including 50% reduction in navigation errors and threefold increase in task completion rates. |